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REMARKS 

Claims 1, 3-20 remain in this application. Claim 2 has been cancelled 
without prejudice. 

Independent claims 1, 16, 20 have been amended to particularly recite that 
the ''buffering" takes place at the server, distinguishing the independent claims 
from Katseff. This amendment further addresses the Examiner's concern that the 
"Applicant's independent- claim limitations do not specify where the 
buffering/synchronization takes place " 

35 U,S,C. S102 

Claims 1, 9, and 16 are rejected under 35 U.S.C §102 as being anticipated 
by U.S. Patent No. 5,822,537 to Katseff et al (Katseff). Applicants respectfully 
traverse the rejection. 

The claimed invention is directed to synchronizing asynchronous time- 
based and motion data by retrieving from a server frames of data that make up a 
time-based data stream and a motion data stream, variably buffering one of the two 
streams, and producing two streams with synchronized frames. The two streams 
with synchronized frames are played at a client, producing synchronized motion 
and time-based data. (See Specification, Page 2, lines 1-12). Synchronization of 
the data frames (data streams) takes place at a synchronizer prior to transmitting 
the synchronized data streams to a network, eliminating the need for the client to 
synchronize the data streams. (See Specification, page 9, lines 3-6 and Fig. 4) 

Amended Claim 1, for example, recites a method of synchronizing 
asynchronous time-based and motion data in a system in which the time- 
based data and motion data are transmitted by a server over a network to a 
client, the method comprising: 
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retrieving a time-based data stream and a motion data stream at the 
server, each stream comprising frames of data; 

variably buffering one of the time-based data stream and the motion 
stream at the server to produce two streams having synchronized frames; 
and 

using the synchronized frames at the client for playback of 
synchronized motion and time-based data to a user. 

The method of claim 1 is not disclosed by Katseff Katseff shows a 
multimedia system to record, store and distribute multimedia presentations 
together with materials that may be referenced during the presentation (see 
Abstract of Katseff). Katseff shows a continuous media and storage retrieval 
system used for digitizing and compressing audio, video, and other continuous data 
(Katseff at col. 5 lines 18-22). Katseff shows a digitizer/compressor that generates 
a data stream that preferably is in JPEG file format. JPEG file format is preferred 
because of the inherent synchronization of audio and video streams (Katseff at col 
6, lines 60-67 through col. 7, lines 1-7). Katseff further shows an information 
retrieval system that allows a user to access multimedia information that has been 
stored in a plurality of databases (Katseff at col. 8, lines 18-22). Katseff does not 
disclose accessing of separate audio (time-based) and video (motion-based). 

In Katseff, a workstation (client) retrieves several frames of audio and 
video from a file server for storage in an audio buffer and a video buffer at 
workstation. No buffering and synchronization is made as to the audio and video 
frames at the server. Katseff discloses that it is preferred that the workstation (or 
client) will have a mechanism to synchronize the presentation of the various 
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outputs (audio and video) (Katseff at col. 8, lines 60-65 through col. 9, lines 1-5). 
Katseff does not disclose that audio and video frames be synchronized prior to 
receipt at the workstation. 

Claim 1 in part recites "retrieving a time-based data stream and a motion 
data stream at the server, each stream comprising frames of data." Katseff does 
not show this aspect. 

The Examiner has interpreted this as "accessing of separate audio (time- 
based) and video (motion-based) data." Para. 22 of OA. The Examiner argues 
that a JPEG movie file interleaves a frame of audio and video (which can be 
interpreted as a movie separated into separate audio and video component frames) 
(Katseff column 6, lines 64-67). Applicant does not disagree with the Examiner's 
definition of a JPEG movie file, however, Katseff discloses a single data stream. 
That single data stream has interleaved frames of audio and video. In contrast, 
claim 1 recites retrieving both a time-based data stream and a motion data stream 
at the server. These are two distinct streams which are retrieved at the server. 
Katseff does not disclose or teach that two distinct streams, time-based stream and 
motion data stream, are retrieved from a server. 

Since the JPEG movie file format is chosen for the "inherent 
synchronization of the audio and video streams," the recited element of * Variably 
buffering one of the time-based data stream and the motion stream at the server to 
produce two streams having synchronized frames" would not be needed and is not 
disclosed or taught by Katseff, since the JPEG movie file format seems to address 
the synchronization of the audio and video streams. 

The Examiner notes that Katseff discloses "a method for relieving network 
congestion by monitoring buffers* threshold and compensating by reducing video 
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transmittal rate, then reducing audio playback rate" (Katseff - title). The title of 
Katseff discloses that ''monitoring buffers' threshold" is to relieve network 
congestion. Katseff does not disclose or teach buffering to produce two streams 
with synchronized frames. While Katseff discloses use of audio and video buffers, 
these buffers are located at the client and not at the server (Katseff, column 8, lines 
60-67). Since Katseff uses an inherently synchronized file format, it does need 
buffers at the server to "variably buffer the two streams at the server 

For these reasons, claim 1 is patentable over Katseff. Applicants 
respectfully request that the §102 rejection of claim 1 be withdrawn. 

Dependent claim 9 is allowable by virtue of its dependency on base claim 
1. For the reasons given above with respect to claim 1, the systems and methods 
recited in claim 9 are neither disclosed nor taught by Katseff. Applicants 
respectfully request that the § 102 rejection of claim 9 be withdrawn. 

Amended Claim 16 recites an apparatus resident on a server for 

synchronizing asynchronous time-based and motion data in a system in 

which the time-based data and motion data are transmitted by the server 

over a network to a client, the apparatus comprising: 

a data retriever for retrieving a time-based data stream and a motion 

data stream at the server* each of the streams comprising frames of data; 

a data stream synchronizer for buffering one of the time-based data 

stream and the motion stream to produce two streams having synchronized 

frames; and 

a packetizer for packaging synchronized frames of motion data and 
time-based data for use at the client for playback of synchronized motion 
and time-based data to a user. 
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As discussed above, Katseff does not disclose accessing of separate audio 
(time-based) and video (motion-based) streams which are two distinct streams. 
Katseff shows a workstation (client) that retrieves several frames of audio and 
video from a file server for storage in an audio buffer and a video buffer. No 
synchronization is made at the server as to the audio and video frames. Katseff 
suggests that the workstation (client) have a mechanism that synchronizes the 
presentation of the various outputs (audio and video) (Katseff at col. 8, lines 60-65 
through col. 9 a lines 1-5). Katseff does not disclose that audio and video frames be 
synchronized (at the server) prior to receipt at the workstation. Katseff further 
describes that audio and video frames be buffered at the workstation and that the 
workstation include a mechanism for synchronization of audio and video frames 
for playback. 

Claim 16 in part recites "a data stream synchronizer for buffering one of the 
time-based data stream and the motion stream to produce two streams having 
synchronized frames." Katseff does not show this aspect As discussed, Katseff 
discloses buffering audio and video frames; however, Katseff does not disclose 
that the frames are synchronized with one another by buffering one of the time- 
based and motion stream, and in particular at the server. Further Katseff does not 
disclose that two streams having synchronized frames are produced from the 
buffering at the server. 

Claim 16 in part recites "a packetizer for packaging synchronized frames of 

22 motion data and time-based data for use at the client for playback of synchronized 

23 motion and time-based data to a user." Katseff does not show this aspect. As 

24 discussed above, Katseff does not disclose synchronized frames of motion and 

25 
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time-based date. Therefore, Katseff would have no need to package such 
"synchronize frames." 

For these reasons, claim 16 is patentable over Katseff. Applicants 
respectfully request that the §102 rejection of claim 16 be withdrawn. 

35U.S.C. 81Q3 

Claims 2» 4. 12. 14, and 18 

Claims 2, 4, 12, 14, and 18 are rejected under 35 U.S.C. §103 as being 
unpatentable over Katseff in view of Shibata, Y M Media Synchronization Protocols 
for Packet Audio- Video Systems on Multimedia Information Networks (Shibata), 
IEEE, January 3-6, 1995. Applicant respectfully traverses the rejection. Claim 2 
has been canceled. 

Claims 4 and 12 depend from claim 1 and hence incorporate the features of 
claim 1. As such claims 4, and 12 require "...retrieving a time-based data stream 
and a motion data stream at the server, each stream comprising frames of data; 
variably buffering one of the time-based data stream and the motion stream at the 
server to produce two streams having synchronized frames; and using the 
synchronized frames at the client for playback of synchronized motion and time- 
based data to a user." 

Katseff does not suggest nor teach retrieving both a time-based data stream 
and motion data stream, Katseff shows retrieving single data streams such as a 
JPEG data stream (Katseff col. 6> lines 60-65). Katseff does not suggest nor teach 
synchronizing frames of the time-based data stream and the motion data stream at 
a server to produce two streams of synchronized frames, by buffering one of the 
data streams. Katseff discloses buffering, however, the buffering of audio and 
video frames does not produce synchronized frames and takes place at a client 
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(Katseff at coL 8, lines 60-65)* Katseff relies on a mechanism at the workstation 
(client) to synchronize audio and video frames (Katseff at coL 9, lines 1-5). The 
workstation (client) therefore never receives synchronized frames for playback. 
The workstation is required to synchronized the frames with a built-in 
synchronizing mechanism. Katseff does not suggest nor teach "using the 
synchronized frames at the client for playback of synchronized motion and time- 
based data to a user." 

Examiner points out that Shibata teaches a rate control message that is sent 
to a server. The rate controller described on page 596 of Shibata does not suggest 
that data streams be variably buffered. Shibata's rate controller monitors a current 
video frame rate with a set video frame rate value and adjusts the video frame rate 
depending on the difference between the set video frame rate value and the current 
video frame rate value. Further Shibata does not suggest that audio or time-based 
rate values can be controlled. Shibata states that "since the audio segment rate is, 
relatively, much smaller than that of the video, audio segments do not require rate 
control ... [T]herefore, only the videp frame rate is controlled. (Shibata at page 
596). 

Shibata provides no assistance in light of Katseff as to the recited 
methodology of claim 2, Accordingly, a combination of Katseff and Shibata fails 
to teach or suggest the claimed methods. Applicants respectfully request that the 
§103 rejection of claims 2 be withdrawn. 

Claim 4 further adds "transferring only those data values for a frame that 
have changed since a last frame was transmitted." Frames are synchronized prior 
to transferring of data values. In other words, a time-based frame is synchronized 
with a motion frame; time based and motion based frames are sent with one 
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another. If no change occurs, the frames are not transmitted, Shibata discloses 
displaying (receiving) video frames while silence (no audio) takes place, (Shibata 
at page 597). Shibata describes that synchronization of audio and video takes 
place at the display (client). 

Shibata is cited for its teaching of a method whereby audio data is sent from 
the video server to the client station only during a <c talk spurt/' Shibata provides 
no assistance in light of Katseff as to the recited methodology of claim 4. Both 
Katseff and Shibata suggest and teach that audio and video synchronization takes 
place at the client, teaching against synchronization of frames prior to receipt by 
the client, Accordingly, a combination of Katseff and Shibata fails to teach or 
suggest the claimed methods. Applicants respectfully request that the §103 
rejections of claims 4 be withdrawn. 

Shibata is cited for its teaching of a Tate control message that is sent to a 
server. Shibata provides no assistance in light of Katseff as to the recited 
methodology of claim 12. Accordingly, a combination of Katseff and Shibata fails 
to teach or suggest the claimed methods. Applicants respectfully request that the 
§103 rejection of claim 12 be withdrawn. 

Claim 14 in part recites ".wpackaging synchronized frames of data where 
each frame includes one or more channels of data in a system in which 
synchronized frames are transmitted by a server over a network to a client, the 
method comprising: storing a last data value for each channel in each frame 
transmitted over the network; ...and packaging and transmitting over the network 
only data for channels having changed data values. 

Further claim 14 provides for storing a last data value and transmitting data 
only when data values have changed Examiner points out that "Shibata teaches a 
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method whereby a rate controller periodically monitors and stores in RAM a 
current frame rate, a number computed by frames/second/* Claim 14 is concerned 
with a present (last) data value, storing the present (last) data value, and comparing 
the stored present (last) data value to a subsequent data value. If there is a 
difference in stored and subsequent data values, then the subsequent data value is 
transmitted. As Examiner has pointed out, Shibata looks at a rate change, in 
particular a video rate change. As discussed above, current video rate is compared 
to a predetermined rate (that does not change), and current video rate is adjusted 
according to the difference. The rate control described in Shibata does not suggest 
that values can be compared, and that the value (stored present data value) for 
which subsequent data values are compared against can change* 

Therefore, Shibata provides no assistance in light of Katseff as to the 
recited methodology of claim 14. Accordingly, a combination of Katseff and 
Shibata fails to teach or suggest the claimed methods. Applicants respectfully 
request that the § 103 rejection of claims 14 be withdrawn* 

Claim 18 depends from claim 16 and hence incorporates the features of 
claim 16. As such claim 18 requires "a data retriever for retrieving a time-based 
data stream and a motion data stream at the server, each of the streams comprising 
frames of data; a data stream synchronizer for buffering one of the time-based data 
stream and the motion stream to produce two streams having synchronized frames; 
and a packetizer for packaging synchronized frames of motion data and time-based 
data for use at the client for playback of synchronized motion and time-based data 
to a user." 

Katseff does not suggest nor teach retrieving both a time-based data stream 
and motion stream. Katseff does not suggest nor teach synchronizing frames of 
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the time-based data stream and the motion stream to produce two streams of 
synchronized frames, by buffering one of the data streams. Katseff discloses 
buffering, however, the buffering of audio and video frames does not produce 
synchronized frames (Katseff at col. 8, lines 60-65). Katseff relies on a 
mechanism at the workstation (client), not the server, to synchronize audio and 
video frames (Katseff at col. 9, lines 1-5). Katseff is silent as to packaging 
synchronized audio and video frames, in light of the fact that there are not 
synchronized frames to be packaged in Katseff, 

The Examiner presents the same arguments in rejecting claim 18, as those 
presented in rejecting claim 14. Applicants assert the arguments in support of 
claim 14. Further, the Examiner states that it would have been obvious to one of 
ordinary skill in the art to modify Katseff to incorporate a storage device to hold 
data values referring to Katseff. 

Shibata provides no assistance in light of Katseff as to the recited 
methodology of claim 18, Accordingly, a combination of Katseff and Shibata fails 
to teach or suggest the claimed methods. Applicants respectfully request that the 
§103 rejection of claim 18 be withdrawn. 
Claim 3 

Claim 3 is rejected under 35 U.S.C. §103 as being unpatentable over 

20 Katseff as applied to claim 1, and in view of U.S. Patent No. 5,642,171 to 

21 Baumgartner et al (Baumgartner). 

22 Claim 3 depends from claim 1 and hence incorporates the features of claim 

23 1. As such claim 3 requires "..♦retrieving a time-based data stream and a motion 

24 data stream at the server, each stream comprising frames of data; variably 

25 buffering one of the time-based data stream and the motion stream at the server to 
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produce two streams having synchronized frames; and using the synchronized 
frames at the client for playback of synchronized motion and time-based data to a 
user." 

Applicants present the arguments in support of claims 2, 4, 12, and 14 in 
regards to Katseff. 

Baumgartner is cited for its teaching of a method whereby a current video 
frame number is subtracted from a current audio frame number, Baumgartner; - 
however, provides no assistance in light of Katseff as to the recited methodology 
of claim 3. Accordingly, a combination of Katseff and Shibata fails to teach or 
suggest the claimed methods. Applicants respectfully request that the §103 
rejection of claim 3 be withdrawn. 

Claim 5 and 13 

Claims 5 and 13 are rejected under 35 U.S.C. §103 as being unpatentable 
over Katseff as applied to claim 1 . 

Claims 5 and 13 depend from claim 1 and hence incorporate the features of 
claim 1. As such claims 5 and 13 require "...retrieving a time-based data stream 
and a motion data stream at the server, each stream comprising frames of data; 
variably buffering one of the time-based data stream and the motion stream at the 
server to produce two streams having synchronized frames; and using the 
synchronized frames at the client for playback of synchronized motion and time- 
based data to a user." 

Applicants present the arguments in support of claims 4, 12, and 14 in 
regards to Katseff. 
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1 Accordingly, Katseff fails to teach or suggest the claimed methods. 

2 Applicants respectfiilly request that the §103 rejections of claims 5 and 13 be 

3 withdrawn. 

4 Claims 6, 7, 10, 17, and 19 

5 Claims 6, 7, 10, 17, and 19 are rejected under 35 U.S.C. §103 as being 

6 unpatentable over Katseff as applied to claims 1 and 16, and in further view of 

7 U.S. Patent No. 9,950,202 to Durward et al (Durward)- .. 

s Claims 6, 7, and 10 depend from claim 1 and hence incorporate die 

9 features of claim 1 . As such claims 6, 7, and 10 require *\ . .retrieving a time-based 

10 data stream and a motion data stream at the server, each stream comprising frames 

11 of data; variably buffering one of the time-based data stream and the motion 

12 stream at the server to produce two streams having synchronized frames; and using 

13 the synchronized frames at the client for playback of synchronized motion and 

14 time-based data to a user/ 7 

15 Applicants present the arguments in support of claims 4, 12, and 14 in 

16 regards to Katseff. 

17 Durward is cited for its teaching of a method whereby updated positional 
is data from a person's head position sensor is mapped and used to determine the 

19 position of a virtual being defined fro that user* Durward; however, provides no 

20 assistance in light of Katseff as to the recited methodology of claims 6, 7 and 10. 

21 Accordingly, a combination of Katseff and Shibata fails to teach or suggest the 

22 claimed methods. Applicants respectfully request that the § 103 rejection of claims 

23 6, 7, and 10 be withdrawn. 

24 Claim 17 depends from claim 16 and hence incorporates the features of 

25 claim 16. As such claim 17 requires "a data retriever for retrieving a time-based 
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data stream and a motion data stream at the server, each of the streams comprising 
frames of data; a data stream synchronizer for buffering one of the time-based data 
stream and the motion stream to produce two streams having synchronized frames; 
and a packetizer for packaging synchronized frames of motion data and time-based 
data for use at the client for playback of synchronized motion and time-based data 
to a user." 

Applicants present the arguments in support of claim 18 in regards to 
Katseff. 

Durward is cited for its teaching of a method whereby updated positional 
20 data from a person's head position sensor is mapped and used to determine the 
n position of a virtual being defined fro that user. Durward; however, provides no 
assistance in light of Katseff as to the recited methodology of claim 17. 

13 Accordingly, a combination of Katseff and Shibata fails to teach or suggest the 

14 claimed methods. Applicants respectfully request that the §103 rejection of claims 

15 1 7 be withdrawn. 

t6 Claim 19 recites in part "a method for playing back time-based and motion 

17 based data that has been synchronized comprising: mapping the motion based data 
is to control the movement of virtual figure in a scene displayed at a client; and 

19 playing back in a synchronization with movement of the virtual figure the time- 

20 based data. 9 * 

21 As discussed, Katseff does not disclose nor teach that time-based and 

22 motion based data streams be synchronized with one another prior to playback at a 

23 client (workstation). 

24 Durward is cited for its teaching of a method whereby updated positional 

25 data from a person's head position sensor is mapped and used to determine the 
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position of a virtual being defined fro that user. Durward; however, provides no 
assistance in light of Katseff as to the recited methodology of claim 19. 
Accordingly, a combination of Katseff and Durward fails to teach or suggest the 
claimed methods. Applicants respectfully request that the §103 rejection of claims 
19 be withdrawn. 
Claims 8, 11 

Claims 8, 1 1 are rejected under 35 U.S.C §103 as being unpatentable over 
Katseff as applied to claim 1, and in further view of U.S. Patent No. 5,812,791 to 
Wasserman et al (Wasserman). 

Claims 8 and 11 depend from claim 1 and hence incorporate the features of 
claim 1. As such claims 8 and 11 require "...retrieving a time-based data stream 
and a motion data stream at the server, each stream comprising frames of data; 
variably buffering one of the time-based data stream and the motion stream at the 
server to produce two streams having synchronized frames; and using the 
synchronized frames at the client for playback of synchronized motion and time- 
based data to a user." 

Applicants present the arguments in support of claims 2, 4, 12, and 14 in 
regards to Katseff. 

Wasserman is cited for its teaching of a method whereby images are 
decompressed for the use of textures, or backgrounds with overlays of moving 
video on the still images. Wasserman describes a time stamp which is different 
than a descriptor packet. The time stamp in Wasserman allows video to be 
displayed at determined 0.7 intervals. The descriptor packet of the subject 
application provides information that is provided along with the data frames that 
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describe content. The content in the descriptor packet does not change, unlike the 
video presentation in Wasseraian that is expected to continually change. 

Wasserman provides no assistance in light of Katseff as to the recited 
methodology of claims 8 and 11. Accordingly, a combination of Katseff and 
Wasserman fails to teach or suggest the claimed methods. Applicants respectfully 
request that the §103 rejection of claims 8 and 1 1 be withdrawn. 

Claim 15 

Claim 15 is rejected under 35 U.S.C §103 as being unpatentable over 
Katseff and Shibata as applied to claim 14, and in further view of Wasserman. 

Claim 15 depends from claim 14 and hence incorporates the features of 
claim 14. As such claims 15 requires packaging synchronized frames of data 
where each frame includes one or more channels of data in a system in which 
synchronized frames are transmitted by a server over a network to a client, the 
method comprising: storing a last data value for each channel in each frame 
transmitted over the network; .,.and packaging and transmitting over the network 
only data for channels having changed data values." 

Applicants present the arguments made in support of claim 14 in regards to 
Katseff. 

Wasserman provides no assistance in light of Katseff and Shibata as to the 
recited methodology of claim 15. Accordingly, a combination of Katseff, Shibata, 
and Wasserman fails to teach or suggest the claimed methods. Applicants 
respectfully request that the §103 rejection of claims 15 be withdrawn. 

Claim 20 

Claim 20 is rejected under 35 U.S.C. §103 as being unpatentable over 
Katseff and Durward as applied to claims 10 and 17 above, and in further view of 
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Baumgartner. Examiner points out that claim 20 incorporates substantially similar 
subject matter as claimed in claims 1, 10, 16, and 17. Claim 20 is rejected by the 
same arguments presented in rejecting claims 1, 10, 16, and 17. 

Applicants reassert the arguments presented in support of claims 1, 10, 16, 
and 17 in traversing Examiner's rejection of claim 20. Applicants respectfully 
request that the §103 rejection of claims 20 be withdrawn. 



CONCLUSION 

All pending claims l s 3-20 are in condition for allowance. Applicant 
respectfully requests reconsideration and prompt issuance of the subject 
application. If any issues remain that prevent issuance of this application, the 
Examiner is urged to contact the undersigned attorney before issuing a subsequent 
Action. 



Respectfully Submitted, 



Dated; By: 



Emmanuel A. Rivera 

Reg. No. 45,760 

(509) 324-9256 ext 245 
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